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Abstract 

The  purpose  of  this  study  was  to  develop  and  pilot-test  an  instrument  that 
determines  the  relationship  between  perceptions,  intended  use,  and  actual  use  of 
the  personal  digital  assistant  (PDA)  by  primary  care  physicians  for  drug 
information  access  and  prescribing.  The  instrument  studied  addressed  human 
factor  limitations,  attitudes  toward  learning  to  use  the  PDA,  and  fear  of  losing 
either  confidential  information  or  the  PDA  itself.  The  study  instrument  was 
intended  to  differentiate  between  applications  a  physician  will  or  will  not 
incorporate  into  daily  practice  and  to  predict  which  physicians  are  more  likely  to 
successfully  adopt  use  of  a  PDA.  A  63-item  survey  was  administered  at  baseline 
to  78  primary  care  physicians,  randomized  into  control  and  intervention  groups. 
The  physicians  in  the  intervention  group  were  provided  a  PDA  with  electronic 
prescribing  software  and  drug  information  software,  training  in  the  use  of  the 
device  and  the  software,  and  an  infrared  printer  to  write  prescriptions.  They  were 
then  asked  to  prescribe  using  the  PDA  or  by  hand,  as  they  preferred.  The  control 
group  physicians  continued  traditional  handwritten  prescribing  and  accessed  their 
usual  drug  infonnation  sources.  The  survey  was  readministered  to  both  groups 
after  they  had  completed  500  prescriptions.  Postintervention  data  did  not  support 
ready  acceptance  of  the  PDA  as  a  prescribing  device;  however,  the  physicians  did 
find  the  PDA  useful  for  accessing  drug  information  at  the  point  of  care.  Potential 
factors  that  predict  physician  use  of  the  PDA  were  learning-related  attitudes, 
human  factor  limitations,  and  concerns  about  loss  of  confidential  and  critical 
information. 


Introduction 

Personal  digital  assistants  (PDAs)  have  substantial  potential  for  improving  the 
health-related  safety,  quality,  and  efficiency  of  care  by  physicians  in  office-based 
practices.  These  devices  have  already  demonstrated  improved  accuracy  of  patient 
identification  in  the  hospital  setting  and  access  to  patient-specific  medical 
information  for  use  in  diagnosis  and  care  decisions.  ’  Yet,  there  are  few 
references  relating  to  adoption  of  information  technology  by  family  and  general 
practitioners  in  small  office-based  practice  settings.3 

Early  experiences  with  this  technology  application  suggest  that  the  PDA’s 
convenience,  ease  of  use,  and  portability  within  the  physician’s  office  solves 
several  logistical  barriers  associated  with  fixed,  desktop  computer  systems  used 
for  similar  purposes.4  Many  respected,  credible,  electronic  information  sources 
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are  now  available  for  these  devices,  and  trends  suggest  that  all  published  expert 
information  resources  will  be  accessible  electronically  in  the  future.5  The  PDA 
also  provides  a  convenient  means  of  generating  a  legible  printed  prescription  at 
the  point  of  care  using  local  wireless  transmission  to  printers. 

Accessing  evidence-based  infonnation  to  improve  medical  decisionmaking  at 
the  point  of  care  and  improving  prescription  legibility  are  critical  steps  to 
improving  medication-related  safety.  However,  it  is  known  that  new  technologies 
create  new  demands  on  users.  Even  a  device  like  the  PDA,  which  features  low- 
level  technology,  will  meet  barriers  to  acceptance  and  use.  Human  factor 
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principles  must  be  addressed  to  account  for  the  human-machine  interface.  ’ 
Introduction  of  PDA  technology  may  also  cause  a  shift  in  workload  to  the 
physician,  placing  further  strain  in  the  work  environment.  This  shift  occurs  at  a 
time  when  office  efficiency  remains  a  medical  office  business  goal.  Therefore, 
technology  acceptance  is  not  a  foregone  conclusion. 

Over  the  past  30  years,  several  theories  have  been  offered  to  explain  the 
acceptance  of  technology  or,  more  specifically,  computer  usage  behavior.  The 
Technology  Acceptance  Model  (TAM)  is  a  recent  theory  developed  by  Davis  et 
al.8  The  TAM  is  an  adaptation  of  the  widely  studied  model  known  as  the  Theory 
of  Reasoned  Action  (TRA),9' 10  a  general  theory  that  postulates  that  actual 
performance  of  a  task  or  function  (behavior)  is  based  on  an  individual’s 
behavioral  intention  (BI).  Behavioral  intention  is  determined  by  both  the 
individual’s  attitude  (A)  and  the  subjective  nonn  (SN)  concerning  the  behavior  in 
question  (Figure  1).  Attitude  is  a  person’s  positive  or  negative  feelings  about 
performing  the  target  behavior.  Subjective  nonn  is  the  person’s  perception  of 
what  other  people  think.9  Behavioral  intention  measures  the  strength  of  one’s 
intention  to  perform  a  specified  behavior.  According  to  TRA,  attitude  toward  a 
behavior  is  detennined  by  beliefs  about  the  consequences  of  performing  the 
behavior  multiplied  by  the  evaluation  of  those  consequences.  Subjective  nonn  is 
determined  by  normative  beliefs  multiplied  by  a  motivation  to  comply  with 
perceived  expectations. 

The  Technology  Acceptance  Model  is  based  on  TRA  and  was  developed  to 

o 

specifically  explain  computer  usage.  One  similarity  between  TAM  and  TRA  is 
that  both  models  postulate  that  behavioral  intention  (BI)  is  determined  by  attitude 
(A).  However,  TAM  adds  a  perceived  usefulness  (PU)  construct  and  a  perceived 
ease  of  use  (PEOU)  construct.  Perceived  usefulness  is  the  prospective  user’s 
subjective  probability  that  using  a  specific  application  system  will  increase  job 
performance  within  an  organizational  context.  Perceived  ease  of  use  refers  to  the 
degree  to  which  the  prospective  user  expects  the  target  technology  to  be  free  of 
effort.  TAM  postulates  that  BI  is  detennined  by  both  A  and  PU  (Figure  1).  Unlike 
the  TRA,  TAM  does  not  include  SN  as  a  determinant  of  BI.  Social  norm  was  not 
included  in  TAM  because  of  uncertain  theoretical  and  psychometric  status. 
According  to  TAM,  A  is  detennined  by  PU  and  PEOU.  Perceived  usefulness  and 
perceived  ease  of  use  have  both  been  theorized  to  be  determined  by  external 
variables.  In  the  case  of  the  PDA,  relevant  external  variables  that  affect  ease  of 
use  include  system  features  such  as  drop-down  menus,  use  of  graffiti 
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Figure  1.  Schematic  representation  of  the  Theory  of  Reasoned  Action  and  the 
Technology  Acceptance  Model 


Technology  Acceptance  Model 


Theory  of  Reasoned  Action 


abbreviations,  and  the  touch  screen  stylus.  An  example  of  perceived  usefulness 
beliefs  would  be  the  ability  to  compare  two  drug  information  sources  that  are 
equally  easy  to  operate  on  a  PDA.  This  comparison  may  indicate  that  one 
electronic  drug  infonnation  source  is  used  more  frequently  than  the  other  simply 
because  it  gives  more  reliable  and  accurate  information.  Perceived  usefulness 
beliefs  are  likely  influenced  by  learning  based  on  feedback. 

Although  these  two  theoretical  models  have  made  significant  contributions 
toward  behavior  theory,  TAM  has  not  yet  been  tested  in  the  application  setting  to 
determine  how  behavioral  intention  relates  to  actual  technology  use.  This  project 
studies  how  both  the  constructs  that  determine  behavioral  intentions  and 
behavioral  intentions  themselves  relate  to  actual  use  of  PDAs  by  physicians  for 
drug  infonnation  and  prescribing  in  office-based  practices.  This  project  also 
recognizes  the  contribution  of  learning-related  attitudes  and  of  specific  external 
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variables  such  as  psychomotor  skills  that  may  influence  behavior  intentions  and 
actual  usage  of  hand-held  technology. 

The  learning  of  new  technology  (the  PDA)  and  its  applications  (prescription 
writing  and  drug  information)  by  physicians  in  office-based  practices  is  the 
specific  focus  of  the  current  study.  The  investigators  viewed  primary  care 
physicians  as  adult  learners  who  were  making  decisions  about  the  acceptance  of 
PDA  technology  into  every  day  practice. 

Adult  learners  have  been  shown  to  invest  new  learning  selectively  into  efforts 
that  they  perceive  to  be  of  substantive  value.  There  is  little  evidence  to  help  us 
understand  the  variables  that  influence  adult  learners  regarding  technology  use. 
Several  variables  have  been  studied  in  students,  however,  as  possible  predictors  of 
application,  learning,  and  achievement  with  computers  in  higher  education. 
Variables  studied  in  relationship  to  student  attitudes  toward  computers  in 
education  have  included  locus  of  control,  gender,  computer  aptitude,  previous 
computer  experience,  prior  attitudes  toward  computers,  beliefs,  and  perceived 
usefulness  of  computers.11  14  No  published  studies  have  been  shown  to  predict 
computer  technology  adoption  in  relationship  to  these  or  other  variables. 


Purpose 

The  purpose  of  this  study  was  to  develop  and  pilot-test  a  survey  instrument 
that  detennines  how  physicians’  perceived  usefulness  of  the  PDA,  perceived  ease 
of  use  of  the  device,  attitudes  toward  using  PDAs,  and  fear  of  losing  either 
confidential  infonnation  or  the  PDA  itself  relate  to  intended  and  actual  use  of  the 
PDA  for  accessing  drug  information  and  prescribing  in  daily  medical  practice. 
Ease  of  use  in  the  context  of  human  factor  limitations,  attitudes  toward  PDA  use 
as  they  relate  to  learning  technology,  and  fear  of  loss  of  confidential  information 
or  the  PDA  itself  have  not  been  previously  studied  within  the  general  theory  of 
TAM.  Our  aims  were  to  develop  an  instrument  for  use  with  physicians  (both  new 
and  experienced  PDA  users)  that  would  (1)  predict  which  applications  a  physician 
will  or  will  not  voluntarily  choose  to  incorporate  into  daily  practice,  and  (2) 
determine  those  physicians  who  would  be  more  likely  to  successfully  adopt  a 
PDA  for  drug  infonnation  and  prescribing. 


Methods 

Subjects  and  setting 

A  convenience  sample  of  78  primary  care  physicians  in  31  office-based 
practices  located  in  eastern  Nebraska  and  western  Iowa  participated  in  this  study. 
The  subjects  were  participating  in  a  randomized,  controlled-trial  field  study 
designed  to  detect  prescribing  errors  by  primary  care  physicians.15' 16  Most  of 
these  physicians  were  new  PDA  users  who  were  inexperienced  at  learning  this 
hand-held  technology,  but  they  varied  in  their  general  computer  use  experience. 
Seventy-five  percent  of  the  subject  physicians  were  men  and  25  percent  were 
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women,  with  an  average  age  of  42  years.  The  offices  were  predominantly  family 
medicine  primary  care  practices  (85  percent  family  medicine,  15  percent  internal 
medicine).  The  offices  had  an  average  of  2.1  practitioners  each,  ranging  from  one 
to  seven  physicians  per  office.  These  Midwestern  offices  were  typical  of 
independent  primary  care  offices  nationally:  all  were  urban  with  the  exception  of 
one  rural  practice.17 

Administration  of  the  instrument 

A  pre-  to  postintervention  design  was  used  to  determine  the  relationship 

between  perceptions,  intended  use,  and  actual  use  of  the  PDA  for  accessing  drug 

information  and  prescribing  in  daily  medical  practice.  A  63-item  survey  was 

administered  at  baseline  to  detennine  the  perceptions  and  intended  PDA  uses  of 

the  study  population  in  their  own  office  practice  settings  using  the  self- 

1 8 

administered,  interviewer-assisted  technique. 

After  the  survey  administration  was  completed,  the  physicians  were 
randomized  to  either  a  control  or  intervention  group.  The  physicians  in  the 
intervention  group  were  provided  a  hand-held  PDA  with  electronic  prescribing 
software,  drug  information  software,  and  an  infrared  printer  they  could  place  in 
the  practice  to  optimize  convenience  in  workflow.  Onsite  competency-based 
instruction  was  provided  about  how  to  properly  use  the  technology  to  write  and 
print  prescriptions.  This  initial  training  program  was  held  in  their  office-based 
practices.  The  training  consisted  of  demonstrating  and  educating  the  physicians 
about  the  PDA  itself,  local  infrared  printing  functions,  and  the  software 
applications.  The  use  of  the  applications  was  taught  with  an  applied  clinical  case 
approach.  Each  subject  had  to  respond  to  the  drug  information  questions 
associated  with  each  case  presented,  using  the  PDA  software  as  the  infonnation 
source.  Each  subject  was  given  a  verbal  order  for  prescriptions,  and  he  or  she  had 
to  generate  a  printed  prescription  using  the  software  installed  on  the  PDA. 
Subjects  had  to  successfully  demonstrate  their  ability  to  use  the  PDA  device  and 
the  drug  information  and  prescribing  software.  Their  perfonnance  was  assessed 
by  the  field  researcher,  using  a  set  of  objective  criteria.  The  subjects  had  to  meet 
all  of  the  performance  criteria  in  order  to  start  using  the  PDA  in  the  intervention 
phase  of  the  study. 

After  introduction  and  training,  the  individuals  in  this  group  could  choose 
when,  how  often,  and  for  what  purpose  they  would  use  the  device.  They  were  not 
required  to  use  the  PDA  and  applications  after  completing  the  training.  The 
control  group  physicians  continued  traditional  handwritten  prescribing  and 
accessed  the  usual  drug  information  sources  found  in  their  practice  sites. 

All  physicians  in  both  groups  were  asked  to  continue  prescribing  for  their 
patients  in  their  normal  practice  environments.  Once  the  physicians  completed 
500  prescriptions  each,  the  survey  instrument  was  then  readministered  to  both 
groups  to  assess  perceptions  and  actual  PDA  use. 
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Construction  of  the  instrument 

The  survey  instrument  covered  the  following  topics: 

Perceived  usefulness: 

1 .  Physician  beliefs  about  the  usefulness  of  a  PDA  to  access  drug 
information  resources  at  the  point  of  care. 

2.  Physician  beliefs  about  the  usefulness  of  the  PDA  to  improve 
prescribing. 

3.  Physician  beliefs  about  the  impact  of  the  PDA  on  their  work 
efficiency. 

Perceived  ease  of  use: 

4.  Physician  perceptions  about  human  factor  limitations  with  computers 
and  PDAs. 

5.  Physician  perceptions  about  their  abilities  to  use  PDAs  and  computers. 
Attitudes  toward  use: 

6.  General  emotional  reaction  of  physicians  toward  computers. 

7.  Physician  attitudes  toward  learning  in  relation  to  computers  and  PDAs. 
External  factors: 

8.  Physician  attitudes  about  loss  of  PDAs  and  patient-related  information. 

A  review  of  the  health  and  technology  literature  at  the  time  of  this  work 
revealed  few  reports  that  provided  valid  measurement  scales  for  predicting 
computer  acceptance.  No  published  instruments  were  readily  available  for  use 
to  meet  this  study’s  purposes  related  to  small  hand-held  computing  devices,  drug 
information,  and  prescribing  applications.  The  survey  items  were  developed  to  be 
consistent  with  the  TAM  and  to  incorporate  learning  as  part  of  the  construct  of 
attitudes  toward  general  use.  Direct  observation  of  primary  care  office-based 
physicians  at  work  guided  item  development.  The  survey  also  included 
assessment  of  specific  attitudes  toward  using  a  PDA  related  to  patient 
confidentiality  and  loss  of  information  or  the  device  itself.  The  constructs  also 
included  ease  of  PDA  use,  specifically  as  dependent  upon  human  factors  that 
cause  limitations  to  device  use.  We  reviewed  human  factors-related  literature  and 
organization  resources  such  as  the  published  guidelines  of  the  Centers  for  Devices 
and  Radiologic  Health  of  the  U.S.  Food  and  Drug  Administration.  We  also 
reviewed  the  Veterans  Affairs  Center  for  Patient  Safety’s  published  materials  and 
background  on  technology  and  safety.  “  “  Educational  research  literature  on 
attitudes  and  beliefs  about  computers  and  student  learning  guided  the 
development  of  the  items.24  27  Two  instruments  developed  through  assessment  of 
student  attitudes  toward  computers  were  identified  in  the  published  literature. 

Both  instruments  demonstrated  strong  internal  consistency.  Reliability  as 
measured  by  Cronbach’s  coefficient  alpha  ranged  from  0.84  to  0.94.  These  two 
instruments  proved  useful  in  furthering  our  own  instrument  development  for  use 
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with  primary  care  physicians.  We  reviewed  each  item  in  these  two  instruments  for 
its  relevance  to  the  conceptual  framework  in  this  study.  The  items  chosen  for 
inclusion  from  the  existing  instruments  were  evaluated  with  a  practical 
understanding  of  the  differences  between  student  subjects  and  our  study 
population.  If  the  item  was  relevant  to  this  study  and  had  a  published  alpha 
greater  than  0.65,  it  was  included  in  our  survey. 

To  avoid  response  set  bias,  equal  numbers  of  positively  stated  and  negatively 
stated  items  were  included  on  the  first  pilot  instrument.  All  of  the  items  were 
arranged  for  scoring  on  a  five-point  Likert  scale,  with  “3”  being  neutral.  The 
instrument  was  piloted  on  six  physicians  to  confirm  the  face  and  content  validity 
of  the  items,  evaluate  the  response  options,  and  reduce  ambiguity. 

Data  analysis 

The  pre-  and  postintervention  survey  data  were  analyzed  separately. 

Constructs  were  developed  by  conducting  factor  analysis  followed  by 
determination  of  Cronbach’s  coefficient  alpha  for  reliability.  Even  though  the 
same  questionnaire  items  were  used  for  the  pre-  and  postsurveys,  different 
constructs  emerged.  The  pre-  and  postintervention  constructs  were  evaluated  and 
compared.  Path  analysis  was  used  to  describe  the  relationship  between  constructs. 

Factor  analysis 

Data  reduction  through  a  factor  analysis  was  conducted  to  refine  the 
instrument  constructs.29  A  principal-components  method  of  factor  analysis 
extraction  was  used  and  analyzed  using  a  correlation  matrix.  All  factors  were 
retained  with  an  Eigen  value  greater  than  1 .  The  factor  analysis  rotation  was 
conducted  using  the  Varimax  method.  The  factors  were  displayed  using  a  score 
coefficient  matrix.  The  following  criteria  were  used  for  initial  item  selection  for 
each  factor: 

1 .  All  items  that  loaded  above  0.35  on  the  rotated  general  factors  analysis 
were  retained. 

2.  Items  that  cross-loaded  on  two  or  more  components  above  0.35  were 
not  retained. 

A  factor  score  was  calculated  for  each  of  the  factors  identified. 

Reliability  analysis 

A  reliability  analysis  was  conducted  on  the  subscales  representing  the 
constructs.  Item-to-total  correlations  were  evaluated  within  each  scale  to 
determine  the  extent  to  which  the  items  related  to  each  other.  Items  were 
reevaluated  for  concept  validity,  and  a  final  decision  was  made  as  to  which  items 
should  be  grouped  together  in  the  same  subscale.  Of  these,  items  with  an  item-to- 
total  correlation  above  0.6  were  retained.  Subscales  were  evaluated  and  a  label 
was  created  that  most  appropriately  reflected  the  concept  represented  by  the 
subscale. 
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Path  analysis 

Path  analysis  was  conducted  using  a  stepwise  multiple  regression  to  determine 
the  strength  and  direction  of  the  relationships  between  constructs.  A  level  of 
significance  of  0.05  was  used  to  detennine  the  best  fit  model. 


Results 

Respondent  characteristics 

No  differences  were  observed  in  distribution  between  the  intervention  and 
control  groups  based  upon  primary  area  of  practice,  gender,  or  age  of  participants. 
There  were  no  differences  in  mean  responses  to  survey  items  at  baseline  between 
groups,  or  between  pre-  and  postintervention  within  the  control  group.  Based 
upon  these  characteristics  of  the  data,  the  cases  from  the  control  and  intervention 
groups  were  pooled  and  treated  as  one  group. 

Prior  experience  with  computers  and  hand-held  devices 

At  baseline,  13  percent  of  the  78  physicians  reported  receiving  some  prior 
formal  training  in  computer  technology,  and  only  3  percent  specifically  reported 
receiving  formal  training  in  the  use  of  PDAs.  The  extent  of  experience  with  PDA 
use  is  minimal,  with  73  percent  reporting  no  use  prior  to  participating  in  this 
study.  Physicians  had  more  experience  with  desktop  computers  than  PDAs.  On  a 
scale  of  1  (no  experience)  to  5  (extremely  experienced),  the  physicians  reported  a 
mean  of  3.3  for  desktop  computers  compared  to  1.9  for  PDAs.  On  a  scale  for 
frequency  of  use  where  1  =  never,  2  =  quarterly,  3  =  monthly,  4  =  weekly,  and  5  = 
daily,  physicians  indicated  using  their  desktop  computer  between  monthly  and 
weekly  (mean  =  3.7),  and  using  the  Internet  at  work  at  least  monthly  (mean  = 

3.3). 

Instrument 

Scale  reliability  was  established  for  seven  constructs  (alphas  ranged  from  0.84 
to  0.94),  five  of  which  held  constant  pre-  to  postsurvey  administration  (Table  1). 
The  number  of  items  in  each  subscale  ranged  from  2  to  5,  with  a  total  of  2 1  items 
for  the  entire  instrument.  The  five  subscales  that  held  constant  pre  and  post  are  in 
the  perceived  usefulness  construct  (beliefs  that  PDA  use  will  generate  more 
accurate  and  complete  prescriptions  and  beliefs  that  PDAs  increase  efficiency), 
the  attitudes  toward  use  construct  (emotional  reaction  to  computers  and  learning- 
related  attitudes  toward  computers),  and  the  external  factor  (less  fear  of  loss  of 
patient  information  with  PDA  use).  These  results  indicate  that  physicians’ 
perceptions  about  the  PDA’s  usefulness  in  preparing  accurate  and  complete 
prescriptions  and  in  increasing  efficiency  held  true  after  gaining  PDA-use 
experience.  Similarly,  perceived  attitudes  toward  PDA  use  and  fear  of  loss  of 
patient  information  held  true  after  gaining  PDA-use  experience. 
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Table  1.  Final  pre-  and  postsurvey  constructs  representing  all  cases 


a  pre  a  post 

Construct  (Domain)  survey  survey 

Perceived  usefulness: 

Beliefs  that  PDAs  will  generate  more  accurate  and  complete  0.90  0.88 

prescriptions  (beliefs) 

•  I  believe  the  use  of  the  PDA  will  improve  the  accuracy  of 
information  on  prescriptions. 

•  I  believe  the  use  of  the  PDA  will  improve  the  completeness  of 
information  on  prescriptions. 

Beliefs  that  PDAs  increase  efficiency  (beliefs)  0.84  0.88 

•  I  believe  the  use  of  a  PDA  will  allow  me  to  deliver  more  care 
within  the  patient  day. 

•  I  believe  the  use  of  a  PDA  will  allow  me  to  have  more  patient 
visits  each  day. 

Beliefs  that  PDAs  save  time  (beliefs)  0.84  a 

•  I  cannot  afford  the  amount  of  time  that  working  with  a  PDA  will 
cause  me  to  slow  down. 

•  I  expect  that  working  with  a  PDA  will  “slow  me  down.” 

•  Electronic  prescribing  via  the  PDA  will  take  me  longer  than 
handwriting  the  prescriptions. 

Perceived  ease  of  use: 

No  human  factors  limitations  with  computing  devices  (psychomotor  b  0.87 

skills) 

•  I  have  difficulty  seeing  when  I  work  with  computers. 

•  I  have  difficulty  seeing  when  I  work  with  small  computing 

devices. 

•  I  have  difficulty  feeling  the  buttons  on  small  computing  devices. 

•  I  have  difficulty  with  using  a  touch  screen  on  PDAs. 

Attitudes  toward  use: 

Emotional  reaction  toward  computers  (attitude)  0.93  0.92 

•  I  find  computers  “unfriendly.” 

•  Computers  make  me  feel  uncomfortable. 

•  Computers  are  frightening. 

•  I  feel  aggressive  and  hostile  toward  computers. 

•  I  get  a  sinking  feeling  when  I  think  of  trying  to  use  a  computer. 

Learning  related  attitudes  toward  computers  (attitude)  0.88  0.89 

•  I  like  learning  on  a  computer. 

•  Computers  make  things  easy  to  learn. 

•  Computers  make  learning  fun. 

External  factors: 

Less  fear  of  loss  of  patient  information  (beliefs)  0.87  0.94 

•  I  am  afraid  that  confidential  information  will  be  lost  because  I 
will  lose  my  PDA. 

•  I  am  afraid  that  critical  information  will  be  lost  because  I  will 
lose  my  PDA. 

Total  items 

Construct  did  not  form  postintervention. 
bConstruct  did  not  form  preintervention. 


No. 

Items 


2 


2 


3 


4 


5 


3 


2 


21 
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Two  constructs  fonned  that  did  not  hold  constant  pre-  to  postintervention.  One 
construct  formed  preintervention  related  to  usefulness  of  PDAs.  It  is  labeled 
“beliefs  that  PDAs  save  time.”  This  unique  construct  formed  around  the 
expectations  that  using  hand-held  devices  would  save  time  and  not  slow  down  the 
physicians  in  their  work.  This  construct  did  not  hold  true  after  PDA-use 
experience,  indicating  that  actual  PDA  use  did  not  result  in  meeting  the  time 
savings  expected  by  physicians.  Three  items  grouped  to  form  the  construct,  with  a 
Cronbach’s  coefficient  alpha  of  0.84.  The  other  construct  formed  postintervention 
related  to  ease  of  use.  It  is  labeled  “no  human  factors  limitations  with  computing 
devices.”  Four  items  grouped  to  form  the  construct,  with  a  Cronbach’s  coefficient 
alpha  of  0.87.  This  construct  fonned  after  PDA-use  experience,  indicating  that 
physicians  did  not  anticipate  experiencing  limitations  using  the  PDA  device,  but 
actually  did.  It  is  noteworthy  that  a  construct  did  not  fonn  around  the  notion  that 
they  expected  to  use  the  PDA  as  a  drug  information  source  in  daily  practice. 

Behavioral  intentions  and  actual  use  outcomes 

A  single  construct  formed  as  a  behavioral  intention  from  the  baseline  survey 
(Figure  2).  This  is  outcome  1 — expectation  that  the  PDA  is  useful  for  writing  and 
printing  prescriptions  (Table  2).  Two  postintervention  survey  outcomes  formed, 
one  as  a  behavioral  intention  and  one  as  actual  use.  Outcome  2,  expectation  and 
attitude  about  PDA  use  in  every  day  medical  practice,  indicated  that  respondents 
like  the  idea  of  working  with  the  PDA  and  that  the  PDA  is  useful  to  their  work. 
The  construct  about  expecting  to  use  the  PDA  daily  formed  as  a  result  of  actual 
PDA  use.  However,  the  additional  outcome  3  that  formed  provided  further 
explanation.  This  construct  indicated  that  physicians  who  are  PDA  users  are 
confident  in  their  use  of  the  PDA,  find  it  easy  to  use,  and  believe  it  is  useful  as  a 
drug  information  resource.  The  preintervention  survey  construct  about  writing  and 
printing  prescriptions  with  the  PDA  as  a  daily  expectation  did  not  remain  intact. 
Postanalysis  indicated  that  physicians  expect  to  use  a  PDA  in  everyday  practice 
only  as  a  drug  information  source,  not  as  a  prescription  writing  and  printing 
device. 

Figure  3  displays  the  relationships  observed  in  the  post-survey  construct 
model.  The  physicians’  expectations/attitudes  about  PDA  use  in  everyday  practice 
were  positively  impacted  by  a  positive  emotional  reaction  toward  computers,  less 
fear  of  patient  infonnation  loss  with  a  PDA,  and  a  positive  belief  about  the  impact 
of  PDAs  on  the  accuracy  and  completeness  of  their  prescription  writing. 
Learning-related  attitudes  and  emotional  reaction  toward  computers  were  highly 
correlated  compared  to  preintervention  data.  Human  factors  limitations  also 
emerged  as  important  after  experiencing  use  of  the  PDA.  Physicians’  confidence 
in  PDAs’  ability  to  increase  work  efficiency  positively  impacted  the  beliefs  that 
physicians  have  about  the  impact  of  PDA  use  on  the  accuracy  and  completeness 
of  prescriptions  and  their  positive  learning-related  attitudes  toward  computers. 
Clinicians  who  did  not  believe  that  the  PDA  brought  value  did  not  expect  to  adopt 
the  PDA  for  daily  use. 
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Figure  2.  Outcome  1 — path  analysis  for  preintervention  data,  all  physicians 
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Table  2.  Outcome  constructs  representing  all  cases:  behavioral  intention  (presurvey) 
and  actual  use  (postsurvey) 


Outcome  Construct 

a  pre 
survey 

a  post 
survey 

No. 

Items 

Presurvey  behavioral  intention  components 

Outcome  1 :  1  expect  to  use  a  PDA  as  part  of  my  everyday 

NA 

NA 

3 

medical  practice. 

Postsurvey  actual  outcome  components 

Outcome  2:  Expectation  and  attitude  about  PDA  use  in 

NA 

0.88 

3 

everyday  medical  practice. 

•  I  expect  to  use  a  PDA  as  part  of  my  everyday 
medical  practice. 

•  I  would  like  working  with  a  PDA. 

•  PDAs  are  useful  in  my  work. 

Outcome  3:  Frequent  user  has  confidence  using  PDA  and  NA  0.84  3 

finds  it  easy  and  useful  for  drug  information. 

•  How  frequently  do  you  use  the  PDA  as  a  source  of 
drug  information? 

•  Indicate  your  confidence  in  the  use  of  a  PDA  in  daily 
practice. 

•  How  easy  is  it  to  use  the  PDA  device  when  using  it 
as  a  source  of  drug  information  in  clinical  situations? 

NA  =  not  applicable 

While  Figure  2  displays  the  relationships  that  formed  between  the  baseline 
survey  constructs  and  behavioral  intention  of  physicians  prior  to  PDA  use,  Figure 
3  shows  the  relationships  that  formed  between  the  postintervention  survey 
constructs,  behavioral  intention  outcome,  and  actual  use  outcome. 


Discussion 

A  universal  expectation  of  physicians  suggesting  that  hand-held  devices 
would  save  time  was  revealed,  as  evidenced  by  the  formation  of  this 
preintervention  construct.  This  construct  did  not  remain  intact  after  users  gained 
experience  with  the  PDA,  suggesting  that  these  expectations  of  saving  time  were 
not  met.  It  is  likely  that  when  introducing  PDA  technologies  to  new  users,  there 
will  be  an  expectation  for  efficiency  that  may  not  be  retained  after  having  the 
experience  of  using  the  technology. 

Learning-related  attitudes  and  emotional  reactions  toward  computers  emerged 
as  important  to  actual  PDA  users.  Adult  learners  expect  their  educational 
experiences  to  be  applicable  to  some  purpose  or  function  they  are  responsible  for. 
The  factors  that  emerged  in  this  study  are  consistent  with  this  notion.  However, 
respondent  general  emotional  reaction  to  computers  emerged  as  an  overarching 
factor — a  factor  that  suggests  that  education  and  training  for  users  must  respond 
to  this  affective  domain.  Learners  need  to  be  taught  in  ways  that  introduce  fun  and 
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Figure  3.  Path  analysis  for  postintervention  data,  all  physicians 
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create  joyful  experiences  while  learning  this  technology.  Specific  approaches  for 
overcoming  negative  emotional  reactions  to  computers  are  needed. 

Three  components  emerged  related  to  PDAs:  beliefs  that  PDAs  will  generate 
more  accurate  and  complete  prescriptions,  beliefs  that  the  use  of  PDAs  will 
improve  patient  care  efficiency,  and  reduced  fears  of  losing  patient  infonnation  as 
well  as  the  device  itself.  Beliefs  about  the  potential  usefulness  of  the  PDA  for 
improving  prescribing  and  performance  were  generally  positive.  Physicians 
believed  that  improved  accuracy  and  completeness  of  prescription  information  are 
related  to  use  of  a  PDA.  However,  physicians’  experiences  with  using  the  PDA 
had  a  negative  influence  on  their  voluntary  use  of  the  PDA  to  prescribe  and  print 
prescriptions. 

Despite  this,  beliefs  about  the  PDA’s  impact  on  efficiency  were  positive. 
Physicians  believed  there  was  a  relationship  between  using  a  PDA  and  their 
ability  to  see  more  patients  each  day  or  to  deliver  more  care  per  visit.  In  general, 
they  thought  the  PDA  was  more  likely  to  improve  the  quality  of  general  patient 
care.  Training  may  need  to  focus  on  emphasizing  reasonable  expectations  about 
the  PDA’s  impact. 

Physicians  who  expected  to  use  the  PDA  in  daily  practice  were  consistently 
less  concerned  about  the  loss  of  critical  and  confidential  patient  information 
resulting  from  losing  or  misplacing  their  PDA  when  compared  to  those  who  did 
not  expect  to  use  it  daily.  Teaching  good  practice  in  device  storage  and 
management  may  be  a  simple  but  important  strategy  to  facilitate  adoption  of  PDA 
use. 

The  postintervention  formation  of  the  construct  labeled  “no  human  factors 
limitations  with  computing  devices”  suggests  that  some  individuals  will  not  use  a 
PDA  in  daily  practice  if  there  are  physical  and  sensory-related  barriers  to  use. 
Only  a  small  percentage  of  the  general  physician  population  will  likely  be 
hindered  by  physical  barriers/ability-related  barriers.  Preliminary  results  indicated 
that  a  relationship  between  these  human  factors  and  lack  of  adoption  in  daily  use 
does  exist.  Practical  methods  to  compensate  for  these  barriers  need  to  be 
identified  at  the  outset  in  order  to  address  the  needs  of  these  few  individuals 
during  training. 

Finally,  there  is  a  shift  in  perceptions  about  usefulness,  ease  of  use,  and 
attitudes  toward  PDAs  as  a  result  of  the  experience  of  actual  use.  Expectations 
about  the  usefulness  and  ease  of  use  of  technology  can  be  inaccurate  prior  to  use. 
Prior  to  the  intervention,  physicians  expected  prescribing  efficiency  to  be  the 
primary  usefulness  of  the  PDA.  After  experiencing  PDA  use,  access  to  drug 
information  at  the  point  of  care  became  the  primary  usefulness  of  the  PDA. 
Education  and  training  should  focus  on  correcting  inaccurate  perceptions  to 
improve  the  rate  and  extent  of  technology  acceptance. 

Limitations 

The  limited  sample  size  precludes  the  investigators  from  establishing 
construct  validity.  A  minimum  sample  size  required  pooling  data  in  order  to 
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conduct  the  path  analyses.  A  larger  sample  to  test  this  instrument  is  needed  to 
better  define  the  relationships.  However,  the  subject  selection  and  study  design 
minimized  sources  of  internal  invalidity  related  to  history,  maturation,  testing,  and 
instrumentation. 

Future  research 

The  instrument  has  the  potential  for  predictive  validity.  It  may  be  useful  as  a 
tool  to  discern  who  is  more  likely  to  adapt  to  hand-held  technology  prior  to 
implementing  a  technology-based  program.  Research  should  be  conducted  on  the 
effectiveness  of  technology  teaching  programs  that  incorporate  the  constructs 
formed  as  a  result  of  this  study.  In  addition,  the  retention  of  the  human  factor- 
based  items,  learning  attitudes,  and  fear  of  loss  of  confidential  patient  information 
should  occur  in  larger  samples  in  future  research  to  determine  if  there  is  a 
predictive  association. 


Conclusion 

Our  aim  was  to  describe  the  initial  development  and  pilot-testing  of  an 
instrument  that  would  improve  our  ability  to  differentiate  between  applications 
physicians  will  or  will  not  voluntarily  choose  to  incorporate  into  daily  practice. 
Both  new  and  experienced  hand-held  device  users  comprised  the  sample  of 
physicians.  The  instrument  distinguished  between  the  utility  of  the  PDA  for 
prescribing  and  the  utility  of  the  PDA  for  acquiring  drug  information.  Three 
constructs  of  importance  as  potential  factors  in  physician  adaptation  to  use  of  the 
PDA  emerged  from  this  work:  learning-related  attitudes,  human  factor  limitations, 
and  concerns  about  confidential  and  critical  information  loss.  These  findings 
suggest  specific  content  and  skill  areas  to  include  when  teaching  physicians  how 
to  use  PDAs  and  to  gain  their  acceptance  of  this  technology. 
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